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Abstract 

We illustrate some of the static and dynamic relations discovered by Cohen, Crooks, Evans, 
Jarzynski, Kirkwood, Morriss, Searles, and Zwanzig. These relations link nonequilibrium processes 
to equilibrium isothermal free energy changes and to dynamical path probabilities. We include ideas 
suggested by Dellago, Geissler, Oberhofer, and Scholl-Paschinger. Our treatment is intended to be 
pedagogical, for use in an updated version of our book on Time Reversibility, Computer Simulation, 
and Chaos. Comments are very welcome. 
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I. INTRODUCTION 



The past 18 years have seen an explosion of activity hnking nonequilibrium processes to 
entropy production, fluctuations, and free-energy changes. This work connects equilibrium 
statistical mechanics to far-from-equilibrium dynamics. Typically initial conditions are taken 
from Gibbs' equilibrium ensembles with the subsequent dynamics featuring explicitly time- 
dependent forces. In the end time averages with the time-dependent forces are related to 
equilibrium phase-space averages. This work makes contact with nonequilibrium steady 
state analysis as a longtime lowfield limiting case. Because it sets the stage for further 
theoretical advances and practical applications, these novel force-control activities deserve 
critical consideration. We consider two aspects of this recent research here: (1) calculating 
isothermal free energy differences in terms of far-from-equilibrium work; and (2) calculating 
the relative probabilities of nonequilibrium forward and reversed trajectories. We illustrate 
both these ideas here for a simple nonequilibrium oscillator problem. 

In both cases we can make definite verifiable statements concerning nonequilibrium traiec- 
tories, by relating these trajectories to phase-space distributions taken from Gibbs' statistical 
mechanics. The new work goes well beyond Green and Kubo's linear-response theory in that 
it describes evolving systems far from equilibrium. 

In Section II we describe Jarzynski's recent generalization of Kirkwood and Zwanzig's 
statistical mechanical perturbation theories. In Section III we illustrate these free-energy 
ideas for a toy-model oscillator, using both Hamiltonian and Nose-Hoover dynamics. In 
Section IV we describe one of Crook's relations for the relative probabilities of forward and 
backward trajectories, and apply it to the same model oscillator system. Section V is a 
summary, putting this work in perspective with other contemporary efforts to enhance our 
understanding of nonequilibrium systems. 

II. FLUCTUATIONS IN NONEQUILIBRIUM STEADY STATES 

Gibbs' [l| (and Boltzmann's) statistical mechanics is the well-established last word in 
relating equilibrium thermodynamic properties to microscopic phase-space states. Nonequi- 
librium properties and processes lack such a clear foundation. Their understanding is still in 
a state of flux. Close to equilibrium perturbation theory can be applied. Green and Kubo 
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used linear-response theory to treat the hnear transport laws — Pick's diffusion, Newton's 
viscosity, Fourier's heat conduction. Green and Kubo expressed the transport coefficients in 
terms of equilibrium (Gibbsian) time correlation functions. 

Strongly nonequilibrium situations are still hard to treat theoretically. These harder 
problems include not just the traditional "approach to equilibrium" based on Hamiltonian 
mechanics and Liouville's theorem, but include also analyses of nonequilibrium steady states 
based on deterministic, but mostly nonHamiltonian, thermostats. These thermostats can 
generate fractal steady-state phase-space distribution functions quite different to Gibbs' 
smooth canonical distributions j2|. 

Before computer simulation became commonplace perturbation theory was the most 
promising basis for a thermodynamic treatment of nonequilibrium situations. Kirkwoodjs] 
and Zwanzig|4] computed isothermal free-energy differences directly from Gibbs' equilibrium 
phase-space distributions. Here we illustrate their work, as well as the recent improvements 
which have extended it. 

Kirkwood introduced a "coupling parameter", < A < 1, used to change the Hamiltonian 
by an amount A'H: 

H(g,p,A) = Ho(g,p) + AAH(g) . 

Increasing the coupling parameter from to 1 converts the "reference Hamiltonian" to a 
new one, 'Hi(g,p) = 'Ho{q,p) + A'H(g). The coupling parameter can be used to "turn on" 
an external field, like gravity, or to make a change in the interparticle forcelaw. 

The corresponding A-dependent canonical partition function, Z, and Helmholtz' free en- 
ergy, A, 

^-AiN,v,T,x)/kT ^ ^(^^ T, A) = n [/ / dqdp/h]e~^^'''P'''>/''^ , 

vary smoothly with A from their reference values to the fully-perturbed ones: 

Z(N V T 0) /-i 
A{N, V, T, 1) - A{N, V, T, 0) = kT In 2\n]v,T,1) ^ I ^^^^^^^ ' 

The overall response of the energy to the perturbation XATi made it possible to compute 
the corresponding (Helmholtz) free-energy change. 

19 years later Zwanzig suggested making a "sudden", rather than continuous, change in 
A, providing a simpler formulation of the same free-energy change: 

A(iV, V, T, 1) - A{N, V, T, 0) = kT In j^^^ °| = {An),=o , 



with the average value of the perturbation computed using the phase-space distribution of 
the unperturbed Hamiltonian. If the perturbed and unperturbed phase-space distributions 
are not too different Zwanzig's approach is the simpler and cheaper of the two procedures. 

Kirkwood and Zwanzig's procedures can equally-well be expressed in terms of the equi- 
librium phase-space distribution function f{q,p,T,\): 

fcTln[Z(0)/Z(l)]Kirkwood= f' dXUil I dqdp)f{q,p,T,X)An{q) . 

Jo 

fcTln[Z(0)/Z(l)]zwanzig = midqdp)f{q,p,T,X = O)AH(g) . 

Both these perturbation-theory approaches assume constant temperature throughout. 
Isothermal Monte Carlo simulations are well-suited to these equilibrium perturbation 
approaches [5I. 

Dynamical isothermal simulations became possible with the isokinetic approach to ther- 
mostating of the 1970sl6| and especially with the isothermal canonical thermostat intro- 
duced by Nose in 1984[7|, l8|. With these new temperature-control tools it became possible 
to generalize Kirkwood and Zwanzig's equilibrium phase-space ideas to far-from-equilibrium 



dynamical simulations 
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In 1993 Evans, Cohen, and Morriss suggested a nonequilibrium phase-space measure 
applicable to deterministic thermostated steady-state simulations [9]. Evans and Searles 
clarified the applicability of this nonequilibrium measure (it becomes correct at long times) 
the following year[lo|. 

Jarzynski's profound 1997 insight was that the phase-space distribution function f{q,p, A) 
need not be an equilibrium quasistatic one so long as the A-dependent trajectory, with A = 



A(t), follows Hamiltonian or Nose- Hoover mechanics [ll|]. Then the mechanical description, 
through Liouville's Theorem, describes the nonequilibrium flow of phase-space probablity 
density. 

Let us consider first the familiar Hamiltonian case. Then the probability density 
f{q,p,X{t),t) propagates unchanged, as does also the comoving phase volume ^{q,p,t), 
even if the underlying Hamiltonian HlqjP, X{t)) is wildly time-dependent. This means that 
the initial equilibrium probability density at {qo,Po)- /(q'ojPojA = 0) is identical to the fi- 
nal one, at f{qi,Pi,X = 1) — provided that the intervening (0 — )■ 1) dynamics is 
all Hamiltonian. During the process the "work" done by A along a particular phase-space 
trajectory is W = Jq AT-LdX. Consider then the phase-space average, over the unperturbed 



distribution of trajectory starting points, of e"^^/*^"^ = e~^f^'^ . Here the total work W is 
evaluated at the time when A, after its specified variation along the path, has reached its 
final value of unity: 

///(go,Po, A = 0)e-^«(^=i)/^^rfgrfp = / / A = l)dqdp 

Z{\ = 0)(e-^^/'=^)o = Z{\ = 1) ^ e^A,^^^)/kT ^ (^^-w/kT^^ 

This last equation, Jarzynski's remarkable free-energy identity (or "equality" , or "relation" , 
or "Theorem" ) gives the equilibrium free-energy difference in terms of arbitrarily far-from- 
equilibrium phase-space trajectories. 

The dynamics need not be Hamiltonian. Jarzynski extended the free-energy relation to 
include thermostated Nose-Hoover dynamics Uj . In that thermostated case the comoving 



phase volume changes with time: 

®W _ /W _ {dqdpdQt ^ g-JJcCtO'it 
®(0) fit) {dqdpdOo'"" 

where ({t') is the Nose-Hoover thermostating friction coefficient. In the end the free-energy 

result is exactly the same, as we will detail and check numerically in the next Section, with 

a simple example problem. 

Naturally enough, some doubted these surprising results. See, for instance, references 
[12] and [13]. After some prodding by naysayers, Jarzynski published more details and 
extensions of his proofs, valid for stochastic thermostats as well as for the Hamiltonian 
and Nose-Hoover situations, and including any time-reversible equations of motion which 
maintain the canonical distribution |pL3|]. Let us consider the Nose- Hoover case in more detail. 

For the Nose-Hoover motion equations an "extended" (to include () canonical distribution 
is maintained by the equations of motion: 

Here C is a control variable, controlling the kinetic energy K (x. p^ . Kq is the kinetic 
energy corresponding to the specified temperature T and r is the (arbitrary) relaxation 
time controlling the timescale of the resulting kinetic temperature fiuctuations. This same 
derivation can be carried through with the generalized distribution [including the factor 
g-{C^)^/2j time 0. Multiplying that distribution by the exponential of —W/kT, gives again 
the generalized distribution when A reaches unity and establishes Jarzynski's free-energy 



relation for Nose-Hoover dynamics. The only new aspect is the need to take the changing 
phase- volume change into account, as is most clearly described by Scholl-Paschinger and 
Dellago IJ]. Let us illustrate the Kirkwood-Zwanzig-Jarzynski ideas with a simple example, 
a harmonic oscillator whose force constant varies with time. 



III. THE FREE ENERGY THEOREMS ILLUSTRATED FOR AN OSCILLATOR 

To illustrate first Kirkwood's coupling-parameter idea, as extended later by Zwanzig 
and Jarzynski, consider a thermostated (canonical distribution) one-dimensional harmonic 
oscillator with unit mass. We choose to increase the oscillator force constant k from unity 
to four as \{t) is slowly increased ( "quasistatically" ; "reversibly" ) from to 1: 

1 < [k = 1 + 3A] < 4 — > 

-oo J —oo 



^ ^ (1/2^11 +3A|^ln^W'^-^-°>=ln 



(kT/hui) 



In 



{kT/2huQ) 



In 2 



For simplicity we choose unit temperature, kT = (jp/m) = 1. The completed perturbation 
reduces the rms fluctuations in (g^) by a factor of two and increases the Helmholtz free 
energy by kT In 2. Kirkwood's quasistatic analysis calculates the partition-function ratio by 
integration of the work associated with the perturbation: 

^" Z(iv!v-!T,1) = ~ j\9\nZ/dX)dX = /^\3/2)rfA/(l + 3A) = (l/2)[ln(4)-ln(l)] = ln2. 

From this standpoint the free energy difference is simply the integrated work needed to make 
a very gradual, reversible change in the Hamiltonian. 

Zwanzig's approach is standard perturbation theory. It corresponds physically to a sudden 
change in the Hamiltonian, 

n = {q'+p')/2 ™-:^°(4g2+p2)/2. 

The free energy change can then be written as the average value of the perturbation's effect 
on the unperturbed (A = 0) canonical probabihty density: 

A{N,V,T,0) - A{N,V,T,1) = A;T ln(e~(^/2)^'/'=^)o = kT\n{kT/A)/{kT/2) = -kT ln{2) . 
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Jarzynski's nonequilibrium generalizations of these Gibbsian ideas can be checked by 
using either Hamiltonian or Nose-Hoover dynamics to implement the perturbation. This 
choice is not entirely coincidental. Dettmann showed that single-temperature Nose-Hoover 
mechanics has its roots in an underlying Hamiltonian jisl . 

Using a relaxation time of unity, and unit temperature, the equations of motion for 
(0 < t < 1) in the two cases are: 

q = p ; p = — g(l + 3t) ; / = 3g^/2 [Hamiltonian] ; 

q = p ] p = — g(l + 3t) — (p ; ( = p'^ — 1 ] I = 3g^/2 [Nose — Hoover] . 
For each trajectory we compute the exponential of the work integral 

^-J^W(t')dt/kT ^ ^-W/kT ^ ^lo-h _ 

The complete trajectory integral, /(I) — /(O) includes the work done on the oscillator by the 
perturbation, and includes also (in the Nose-Hoover case) the changing phase volume. 

idt = W/kT [Hamiltonian] ; Idt = W/kT ln[®(0) / ® (1)] [Nose - Hoover] . 
Jo Jo 

In the Nose-Hoover case this last result follows from the useful identity: 

n, = {d/dt)[{q\l + 3t) + / + C')/2] = (3gV2) - C =^ 

! ! !{dqdpdC/h)oe-'^^l^'^e-^l^^ = J J J{dqdpdC/h)ie-^^'''+p'+^''>/^^ = Zi . 

The expression in square brackets is the "extended" Nose- Hoover Hamiltonian "Ha- In the 
Nose-Hoover case the "extended" partition functions Zq and Zi include integrations over 
the thermostat variable (. 

For numerical Runge-Kutta integration of trajectories we chose the initial values of {q,p) 
or {q,p,C) from equilibrium (Gaussian) distributions We veri- 

fied Jarzynski's relations numerically by choosing and analyzing millions of trajectories. We 
computed average values of the left side, {e~^), and the right side, e^^/'^^, of the Jarzynski 
relations. For 100 million collisions, with either Hamiltonian or Nose-Hoover mechanics, 
his predicted average value of the partition-function ratio, / = (1/2), is nicely reproduced, 
with four- to five-figure accuracy, perfectly consistent with both versions of Jarzynski's 1997 
theorem. Such Theorems are also valid for other deterministic and stochastic equations of 
motion as is detailed in References [16]-[19]. 



IV. CROOK'S REVERSIBILITY RELATION 



Crooks and Jarzynski used a variation of these ideas 16| to compute the relative proba 



bihties of forward and reversed nonequihbrium trajectories. Their work makes contact with 



the seminal 1993 and 1994 papers of Evans, Cohen, Morriss, and Searles 9], [l^ . Though 
Crooks and Jarzynski emphasize stochastic dynamics we illustrate one of their results here 
for time-reversible deterministic Hamiltonian dynamics. This version of their Theorem (or 
"result" , or "relation" , or "identity" ) can also be viewed as an illustration (or consequence) 
of "detailed balance" or "microscopic reversibility" , the equal likelihood of forward and back- 
ward trajectories linking two microstates. For convenience we will choose those as states of 
the time-dependent oscillator at times and 1. 

In order to understand their formulation of the problem let us compare two probabilities: 
the "forward" orbit of a canonical oscillator going from the phase point {qo,Po) at time to 
(gi,Pi) at time 1; the "backward" orbit of the oscillator, equilibrated at (gi, —pi) and going 
backward to {qq, —po)- On the forward orbit the force constant increases from 1 to 4; on the 
backward orbit the force constant decreases, from 4 to 1. The probability for the forward 
and reversed trajectories are not equal because the initial energies and free energies differ. 
In the forward and backward directions the normalized rates are proportional to 

e(^-^)°/'='^(cigcip)o ; e^^-^^^^/'^idqdp), , 

with 

AH = Hi-Ho = W = [\3/2)q^dt ; AA = Ai - Aq = kT\n2 . 

Jo 

Evidently the ratio of the forward and backward rates is: 

e(^-H)^/''^{dqdp)i 

The dqdp phase-volume elements cancel according to Liouville's Theorem. This is (one 
of) Crook's "Fluctuation Theorems", a simple consequence of the time reversibility of the 
Hamiltonian equations of motion. Like the free energy theorems, it can easily be checked 
by Runge-Kutta integration. 

If we view the extra dissipated work as a time-integrated entropy production, 

AS = {W- AA)/T , 
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then this fluctuation theorem has the same form as the longtime steady-state relation {q] 



In 



prob{+a) 



[ar/k] 



prob{—a) 

where the entropy production rates a are observed average values during an averaging "time 
window" of length r. 

V. PERSPECTIVES 

Jarzynski's isothermal free-energy relations link equilibrium statistical mechanics to 
nonequilibrium dynamics. Though the Jarzynski work includes arbitrary time- dependent 
forces this approach requires equilibrium initial conditions and is limited to a single flxed 
temperature T. We still need theories for treating more general nonlinear problems, such 
as stationary Shockwaves. Shockwaves link together equilibrium states with two different 



temperatures. Within the shockwave the temperature is a tensor, with T^x Tyy\l^. 

We still need good methods for understanding the fractal phase-space structures of sys- 
tems with two or more temperatures, not just one. So far the only connection between the 
smooth Liouville-Theorem approach of the present work and truly nonlinear steady states 
is at the linear level of the Central Limit Theorem and Green-Kubo linear response. 

The processes for which the recent theorems are relevant involve entropy changes of only 
a few k and energy changes of only a few kT. Macroscopic consequences of the Fluctuation 
Theorems are simply unobservable. Even so, from the theoretical standpoint the new ideas 
are stimulating, relating "real" flnite-rate processes to equilibrium thermodynamics. Unlike 
Kirkwood and Zwanzig's earlier efforts, the new approaches do have counterparts in micron- 
scale laboratory experiments in which long molecules or latex balls are manipulated with 
external forces. The back-and-forth fluctuations in these many-body systems can be approx- 
imated with theoretical results for thermostated models with a few degrees of freedom. See 
the reviews [19] and [20] for references. Evidently all three routes to understanding, theory, 
simulation, and experiment are linked together by these revolutionary ideas. 

From the computational standpoint the new theorems are not particularly "useful" for 
free-energy work. A careful investigation showed that the original ideas of Kirkwood and 



Zwanzig are less costly than Jarzynski's in making numerical free-energy estimates 171 ]. 



The literature on this subject is particularly hard to follow. There is a tension between 
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derivations treating the most general case possible and special cases, which are easier to 
grasp. Fairly widespread confusion is evident from the several papers purporting to find 
flaws in the published proofs. There is an enduring need for more example problems to 
explore the useful ranges of the many theorems. 

The derivations make use of the detailed reversibility of Hamiltonian or thermostated 
mechanics. Systems away from equilibrium for a few Lyapunov times cannot be reversed 
due to Lyapunov instability. Typically the phase volume shrinks, forward in time, so that 
the reversed trajectory, with growing phase volume, is dynamically unstable, and soon seeks 
out a phase-space attractor rather than following the repellor. Shockwaves illustrate another 
difficulty in reversing irreversible processes. From the macroscopic standpoint an attempt 
to reverse a strong Shockwave would result instead in a nearly iscntropic rarefaction fan. 
Whether or not this qualitative irreversibility will have a counterpart in the highly nonequi- 
librium systems which can be treated theoretically remains to be seen. 
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